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(1) Real Party In Interest 

The real party in interest is Hewlett-Packard Development Company, L.P. 

(2) Related Appeals And Interferences 

There arc no other appeals or interferences related to this case, 

(3) Status Of Claims 

Claims 1-3, 5-1 7, 20 and 22-26 are pending of which claims 1 , 23 and 26 are 
independent 

Claims 4, 1 8, 1 9, 21 , 27, and 28 arc canceled. 

All pending claims 1-3, 5*1 7, 20 and 22-26 are hereby appealed 

Claims 1-3, 6, and 23-26 stand rejected under 35 USC § 102(b) as allegedly being 
anticipated by Lee et al. US. Patent No. 5,583,659 ("Lee"), 

Claim 5 stands rejected under 35 USC § 1 03(a) as allegedly being unpatentable over the 
combination of Lee in view of Kodaira ct al. US 6,868,183 ("Kodaira"). 

Claims 8, 10, and 15-1 7 stand rejected under 35 USC § 1 03(a) as allegedly being 
unpatentable over the combination of Lcc and Hashimoto ct al. US 6*987,0450^351110^0") 

Claims 7, 9, 11-14, 20, and 22 are objected to as being dependent upon arqected base 
claim, but would be allowable if rewritten in independent form including all of the limitations of 
the base claim and any intervening claims. 
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(4) Status of Amendments 

No amendment was filed subsequent to the final Office Action dated April 2, 2007. 
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(5) Summary of Claimed S ubject Matter 

Text extraction is a common process in optical character recognition (OCR) systems. 
When pixels that represent text arc identified in OCR systems, they can be separated from other 
pixels and compressed more efficiently. Cuirent techniques to identity pixels, such as global and 
adaptive thresholding, are used with documents having simple text printed on a white 
background- However, the use of different colors and styles of text, as well as colored and 
graphical backgrounds has become increasingly more common {paragraphs 3-1 1). The 
embodiments described herein provide more accurate systems and methods for identifying and 
extracting pixels that represent text 

For example, claim 1 recites a method to identify text-like pixels from an image (FIG. 1), 
the method comprising: 

classifying a plurality of individual pixels within a mask within the image as either edge 
or non-edge, wherein a pixel (i j) is located at the center of the mask (paragraphs 29-31 and FIG. 

4); 

determining whether the pixel (i j) is an edge pixel or a non-edge pixel (paragraphs 29- 

31); 

determining whether pixels having connectivity with the pixel (i j) are edge pixels or non- 
edge pixels (paragraphs 29-31); and 

performing edge-bounded averaging to determine line segments, wherein the edge- 
bounded averaging includes finding one of either 

5 
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im average value of only the edge pixels having connectivity with pixel (i j), in 
response to determining that pixel (i j) is an edge pixel or 

an average value of only the non-edge pixels having connectivity with pixel (i j) in 
response to determining that pixel (i j) is a non-edge pixel (paragraphs 29-31). 

Claim 23 recites a system for identifying text-like pixels from an image (FIG- 12), the 
system comprising: 

a processor for classifying a plurality of individual pixels within a mask within the image 
as either edge or non-edge (paragraphs 83 and 84), wherein a pixel (i j) is located at the cctrtcr of 
the mask; determining whether the pixel (i j) is an edge pixel or a non-edge pixel;, determining 
whether pixels having connectivity with the pixel (ij) arc edge pixels or non-edge pixels; and 
performing edgc-bounded averaging to determine line segments (paragraphs 29-3 1), the edge- . 
bounded averaging including one of either 

finding an average value of only the edge pixels having connectivity with pixel (i j), in 
response to determining that pixel (i j) is an edge pixel or 

finding an average value of only the non-edge pixels having connectivity with pixel (i j) 
in response to determining that pixel (ij) is a non-edge pixel (paragraphs 29-31 )♦ 

Claim 26 recites a computer readable storage medium on which is embedded one or more 
computer programs comprising a set of instructions that when executed by a processing circuit 
performs a method of processing a digital image (FIG, 12, paragraphs 83 and 84), the method 
comprising: 

6 
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classifying a plurality of individual pixels within a mask within the digital image as either 
edge or non-edge, wherein a pixel (ij) is located at the center of the mask (paragraphs 29-31 ); 
determining whether the pixel (i j) is an edge pixel or a non-edge pixel (paragraphs 29- 

31); 

determining whether pixels having connectivity with the pixel (ij) are edge pixels or non- 
edge pixels (paragraphs 29-3 1 ); and 

performing edgc-bounded averaging to determine line segments, wherein the edge- 
bounded averaging includes finding one of cither 

an average value of only the edge pixels having connectivity with pixel (i j), in 
response to determining that pixel (ij) is an edge pixel or 

an average value of only the non-edge pixels having connectivity with pixel (ij) 
in response to determining that pixel (i j) is a non-edge pixel (paragraphs 29-3 1). 
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(6) Grounds of Rejection to be Reviewed on Appeal 

A. Whether claims 1-3,6, and 23-26 should have been rejected under 35 USC § 
102(b) as being anticipated by Lee. 

B. Whether claim 5 should have been rejected under 35 USC § 1 03(a) as being 
unpatenablc over the combination of Lee in view of Kodaira. 

C. Whether claims 8, 1 0, and 15-17 should have been rejected under 3S USC § 
1 03(a) as being unpatcnable over the combination of Lcc and Hashimoto. 
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(7) Arguments 

A, The rejection of claims 1-3, 6, and 23-26 under 35 USC 6 1 02(b) jg improper because 
Lee fails to teach each and every element of claimsl-3, 6. and 23-26. 

The test for determining if a reference anticipates a claim, for proposes of a 

rejection under 35 UJ3.C § 1 02, is whether the reference discloses all the elements of the 

claimed combination, or the mechanical equivalents thereof functioning in substantially the same 

way to produce substantially the same results. As noted by the Court of Appeals for the Federal 

Circuit mLindemann Maschinenfabrick GmbH v. American Hoist and derrick Co,, 221 USPQ 

481, 485 (Fed. Cir. 1984), in evaluating the sufficiency of an anticipation rejection under 35 

U.S.C. § 1 02, the Court stated: 

Anticipation requires the presence in a single prior art reference 
disclosure of each and every element of the claimed invention, 
arranged as in the claim. 

Therefore, if the cited reference does not disclose each and every element of the claimed 

invention, then the cited reference fails to anticipate the claimed invention and, thus, the claimed 

invention is distinguishable over the cited reference. This rejection is respectfully traversed 

because Lee fails to disclose all the features of independent claims 1, 23, and 26, and the claims 

that depend therefrom. 

1. Lee fails to teach "edge-bounded averaging." as recited in claims l„23,_and 

26. 

9 
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Independent claims 1 , 23, and 26 recite that "edge-bounded averaging includes finding an 
average value of only edge pixels hayinfcconncctivitv with pixel (i j), in response to 
deter minin g that pixel (ij) is an edge pixel or an average value of only non-edge pixels having 

connectivity with pixel (ij) in response to determining that pixel (i j) is a non-edge pixel." In 

♦ 

contrast to the claimed features, Lee discloses averaging all pixels within a mask. Lcc docs not 
teach averaging cither only edge pixels or p_nly_non-edge pixels hayin^connectivitv based on the 
classification of the center pixeL In other words, Lee averages every pixel within a mask (or 
window), whereas the claims recite averaging "only " a particular subset of pixels, Lc. edge or 
non-edge having connectivity. 

The Final Office Action alleges that Lee teaches these features in column 8, lines 34-43. 
Lines 34 and 35 of the cited passage state that "if area gradient..excecds the threshold value, GT, 
then pixel (i j) lies in the vicinity of an edge.' 1 The Examiner erroneously concludes that this 
sentence teaches determining if a pixel is an edge pixel or a non-edge pixel. The Examiner then 
appears to rely on the phrase 'In this case," in line 36 of the cited passage, as an implication that 
the additional steps explained in the passage of ascertaining L^ and L^,, and calculating L nvft 
are only performed on edge pixels. The Final Office Action also seems to place particular 
emphasis on the sentence which reads "thereafter, method 200 advances to block 248 which 
calculates an average pixel intensity value." However, it is not clear how these extracts from Lcc 
purportedly teach the claimed features. 

Regarding the Examiner's erroneous conclusion that Lcc teaches edge-bounded 
averaging, the cited passage of Lcc, like the rest of the Lee reference and the other cited art, fails 

10 
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to teach, or even suggest, performing edge-bounded averaging with onljj edge pixels or only non- 
edge pixels, as recited in independent claims 1 , 23, and 26. In contrast to the claimed features, 
Lee teaches averaging all pixels within a window without determining if the non-center pixels in 
the window are edge or non*edge and also without considering the connectivity of the pixels in 
the window. For example, the Applicant notes column 7, lines 15*35, in which Lee provides a 
detailed! explanation of averaging pixel windows. Here, Lee refers to the 3x3 pixel window 
depicted in FIG. 3 A and details a calculation in which every pixel in the window is averaged 
without regard to the connectivity of the pixels or a classification of the other pixels in the 
window as either edge or non-edge. 

Moreover, in column 6, lines 50-55, Lee further teaches that <4 cach and every" pixel goes 
through the same averaging process, which is 'identical across all such pixels," Therefore, Lee 
clearly teaches averaging all pixels in a window and not just the connected only edge or only 
non-edge pixels, as recited in the independent claims, Lee provides absolutely no suggestion that 
only edge or only non-edge pixels can, or should, be averaged Similarly, Lee mokes no mention 
of averaging connected pixels. This is because, Lee teaches averaging all pixels within a pixel 
window, as opposed to averaging "only edge pixels" or "only non-edge pixels'' having 
connectivity with the center pixels. As such, Lcc fails to teach or suggest the above-recited 
features of independent claims 1 , 23, and 26. 

2. Lee fails to tcach^dctcrniining_whcthcr the pixels hayintLConnectivitv with 
pixc!_(ij) M arc_edge pixels or non-edge pixels^ as recited in claims 1,_23, and 26. 

11 
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Lcc also fails to teach "dctennining whether the pixels having connectivity with pixel 
(i j) are edge pixels or non-edge pixels " Connectivity is described by way of example in 
paragraph 3 1 of the originally filed specification and illustrated in Figure 3. Tn contrast to this 
claimed feature, Lee discloses classifying only the center pixel (ij) within a pixel window as 
edge or non-edge* Lee then repeats this process for other center pixels (i j). Lee does not teach 
or suggest detennining any relationships, such as connectivity, between pixels within individual 
windows. Lee simply averages all pixels within each window without regard to their 
connectivity. Therefore, Lee fails to teach determining if pixels having connectivity to pixel (ij) 
are ed ge pixels or non-edge pixels. 

3. Lee_fails_toJcach_pcrfoiTOin^cda 
segmcnts^as recited in claims 1„ 23. and 26, 

in addition, Lee fails to teach performing edgc-bounded averaging to determine line 
segments. Initially, as set forth above, Lee fails to teach performing the claimed edge-bounded 
averaging. However, Lcc also fails to teach or suggest any averaging process to determine line 
segments. Lcc is drawn to thresholding an image to determine if an image is a character or 
background. Lcc fails to teach or suggest performing averaging to determine a line segment. 

Accordingly, it is respectfully submitted that the rejection is improper because Lee foils 
to teach each and every clement of independent claims 1, 23, and 26. Therefore, withdrawal of 
this rejection and allowance of the claims is respectfully requested. 

12 
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B. The rejection of claim 5 under 35 USC 8 103fa) is imp ro per because Lcc in view of 
Kodairn fails to , teach or suggest all the features of claim 5, 



The test for determining if a claim is rendered obvious by one or more references for 

purposes of a rejection under 35 U.S.C. § 1 03 is set forth in MPEP § 706.020): 

To establish a prima facie case of obviousness, three basic criteria 
must be met First, there must be some suggestion or motivation, 
cither in the references themselves or in the knowledge generally 
available to one of ordinary skill in the art, to modify the reference or 
to combine reference teachings. Second, there must be a reasonable 
expectation of success. Finally, the prior art reference (or references 
when combined) must teach or suggest all the claim limitations. The 
teaching or suggestion to make the claimed combination and the 
reasonable expectation of success must both be found in the prior art 
and not based on applicant's disclosure. In re Vaeck 947 F.2d 488, 20 
USPQ2d 1 438 (Fed. Cir. 1991). 

Therefore, if the above-identified criteria arc not met, then the cited reference^) fails to 

render obvious the claimed invention and, thus, the claimed invention is distinguishable over the 

cited reference^). 

Lcc and Kodaira, taken singly or in combination, fail to teach or suggest the elements of 
independent claim 1, from which claim 5 depends, for the reasons set forth above. Accordingly, 
claim S is allowable at least by virtue of its dependence on claim 1 and withdrawal of this 
refection and allowance of the claims is respectfully requested. , 
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C. The rejection of claims 8. 10, and_1S^t_7_undcr 35 USC jLin3faVfo_impropcr because 
Lee invicw ofjlashimotg^^ of claims 8, 10. and 15-17. 

Lee and Hashimoto, taken singly or in combination, fail to teach or suggest the elements 
of independent claim 1, from which claims 8, 10, and 15-17 depend, for the reasons set forth 
above. Accordingly, claims 8, 10, and 15-17 arc allowable at least by virtue of their dependence 
on claim 1 and withdrawal of this rqection and allowance of the claims is respectfully requested* 
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(8) Conclusion 

For at least the reasons given above, the rejection of claims 1 , 3-29, 3 1-33 and 35 is 
improper. Accordingly, it is respectfully requested that such, a rejection by the examiner be reversed 
and these claims be allowed. Attached below for the Board's convenience is an Appendix of claims 
1, 3-29, 3 1-33 and 35 as currently pending and on appeal. 

Please grant any required extensions of time and charge any fees due in connection with 
this Appeal Brief to deposit account no. 08-2025. 



Respectfully submitted, 



Dated: February 20, 2008 



By 




MANNA VA Sc. KANG, P.C. 
1 240 Waples Mill Road 
Suite 300 

Fairfex,VA 22030 
(703) 652-3822 
(703)865-5150 C&csimilc) 
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(9) Claim Appendix 
CLAIMS: 

1. A method to identify text-like pixels from an image; the method comprising: 

classifying a plurality of individual pixels within a mask within the image as cither edge 
or non-edge, wherein a pixel (i j) is located at the center of the mask; 

determining whether the pixel (i j) is an edge pixel or a non-edge pixel; 

determining whether pixels having connectivity with the pixel (i j) arc edge pixels or non- 
edge pixels; and 

performing edge-bounded averaging to determine line segments, wherein the edge- 
bounded averaging includes finding one of cither 

an average value of only the edge pixels having connectivity with pixel (ij), in 
response to determining that pixel (i J) is an edge pixel or 

an average value of only the non-edge pixels having connectivity with pixel (i j) 
in response to determining that pixel (i j) is a non-edge pixel. 

2. The method of claim 1 , further comprising: 

examining sub-blobs of pixels within the image; and 
performing sub-blob connectivity analysis, 

3* The method of claim 2, further comprising: 

16 
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identifying and classifying edges of pixels within the image; 
performing filling to further classify pixels within the image; 
performing consistency analysis of pixels within the image; 
performing pixel connectivity analysis of pixels within the image; and 
identifying text pixels within the image. 

4. (Canceled). 

5. The method of claim 1, further comprising performing color space conversion of the image. 

6. The method of claim 1 , further comprising smoothing the image. 

7. The method of claim 1, wherein a Gaussian lowpass filter is applied to the image* the filter 
being 



where k is a normalising factor such that £yj^=1.0,cis the center of the filter and a =1.0 



. 8. The method of claim 3, wherein the step of identifying and classifying edges of pixels within 
the image further comprises, 

classifying every pixel as NON EDGE, WHITE EDGE or BLACK EDGE. 
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9. The method of claim 8, wherein the step of identifying and classifying edges of pixels within 
the image further comprises: 

(1) calculating a vertical gradient Cjj , a horizontal gradient C\ } , and the magnitude of 
gradient M l } using the formula, 

Where y t j is a pixel luminance value at an index ij 

(2) calculating a discrete Laplarian (a second directive): 

(3) classifying every pixel as the following: 

IfA/ u >y;thcn 

lfi u <0 

Classify pixel at (»«/) as WHITE EDGE 

Else 

Classify pixel at (fj) as BLACK EDGE 

Endif 

Else 
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Classify pixel at (i J) as NON EDGE 

Endif. 

10. The method of claim 1, wherein the step of performing edge-bounded averaging further 
comprises: 

starting from a first side of a line proceeding to a second side of the line identifying 
consecutive segments of pixels as NON EDGE, WHITE EDGE or BLACK EDGE, 

1 L The method of claim I, whereto the step of performing edge-bounded averaging comprises: 

computing the edge-bounded averaging for at least eight locations including both end 
points of a central interior, both end points of a left edge segment, both end points of a right edge 
segment, aright end point of a left interior and a left end point of a right interior. 

1 2. The method of claim 1 1, further comprising: 

classifying the central interior as NON TEXT, BLACK INTERIOR or WHITE 
TNTERTOR based upon the edge-bounded averaging values. 

13. The method of claim 3, wherein the step of performing filling to further classify pixels 
within the image comprises: 

classifying segments as NON TEXT; and 
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examining segments classified as NON TEXT to determine whether they may be 
reclassified as BLACK INTERIOR, BLACK EDGE, WHITE INTERIOR or WHITE EDGE. 

14. The method of claim 3, wherein the step of performing vertical consistency analysis of 
pixels within the image comprises: 

examining pixels not yet classified as NON TEXT to determine whether they are 
BLACK INTERIOR, BLACK EDGE, WHITE INTERIOR or WHITE EDGE, 

15. The method of claim 3, wherein the step of performing pixel connectivity analysis of pixels 
within the image comprises: 

identifying aggregates of pixels having been identified as candidates for text, the 
aggregates being sub-blobs; and 

collecting statistics with respect to each sub-blob, wherein said statistics are selected 
from the group consisting of total number of pixels, sums of color values, number of border 
pixels, number of broken border pixels and horizontal run length. 

1 6. The method of claim 2, wherein the step of examining sub-blobs of pixels within the image 
comprises: 

examining each sub-blob to determine whether it is NON TEXT. 

1 7. The method of claim 3, wherein the step of identifying text pixels comprises: 
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examining each sub-blob to classify each pixel as cither a text pixel or a non-text pixel. 
Claims 18-19 (Canceled). 

20. The computer readable storage medium according to claim 26, said one or more computer 
programs further comprising a set of instructions for: 

performing pixel connectivity analysis of pixels within the digital image identifying 
aggregates of pixels having been identified as candidates for text, the aggregates being sub- 
blobs; 

collecting each sub-blobs statistics: total number of pixels, sums of color values, number 
of border pixels, number of broken border pixels and horizontal run length; and 
counting sums of each luminance and chroma. 

21. (Canceled)* 

22. The computer readable storage medium according to claim 26, said one or more computer 
programs further comprising a set of instructions for: 

performing pixel connectivity analysis of pixels within the digital image by identifying 
aggregates of pixels having been identified as candidates for text, the aggregates being sub- 
blobs; 
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collecting each sub-blobs statistics: total number of pixels, sums of color values, number 
of border pixels, number of broken border pixels and horizontal run length; and counting sums of 
each 7,C n CV 

23. A system for identifying text-like pixels from an image, the system comprising: 

a processor for classifying a plurality of individual pixels within a mask within the image 
as cither edge or non-edge, wherein a pixel (i j) is located at the center of the mask; determining 
whether the pixel (i j) is an edge pixel or a non-edge pixel; determining whether pixels having 
connectivity with the pixel (ij) arc edge pixels or non-edge pixels; and performing edge-bounded 
averaging to dctcrrnine line segments, the edge-bounded averaging including one of either 

finding an average value of only the edge pixels having connectivity with pixel (ij), in 
response to determining that pixel (ij) is an edge pixel or 

finding an average value of only the non-edge pixels having connectivity with pixel (i j) 
in response to determining that pixel (ij) is a non-edge pixel. 

24. The system of claim 23, wherein the processor also examines sub-blobs of pixels within the 
image; and performs sub-blob connectivity analysis. 

25. The system of claim 24, wherein the processor also identifies and classifies edges of pixels 
within the image; performs vertical filling to further classify pixels within the image; performs 
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vertical consistency analysis of pixels within the image; performs pixel connectivity analysis of 
pixels within the image; and identifies text pixels. 

26. A computer readable storage medium on which is embedded one or more computer 
programs comprising a set of instructions that when executed by a processing circuit performs a 
method of processing a digital image, the method comprising: 

classifying a plurality of individual pixels within a mask within the digital image as either 
edge or non-edge, wherein a pixel (i j) is located at the center of the mask; 

detennining whether the pixel (i j) is an edge pixel or a non-edge pixel; 

determining whether pixels having connectivity with the pixel (i j) are edge pixels or non- 
edge pixels; and 

performing edge-bounded averaging to determine line segments, wherein the edge- 
bounded averaging includes finding one of cither 

an average value of only the edge pixels having connectivity with pixel (Lj), in 
response to determining that pixel (i j) is an edge pixel or 

an average value of only the non-edge pixels having connectivity with pixel (i j) 
in response to determining that pixel (i j) is a non-edge pixel. 

Claims 27-28 (Canceled). 
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(10) Evidence Appendix 

None. 
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(11) Related Proceedings Appendix 

None. 
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